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INTRODUCTION 


The  objective  of  the  AXIS  (Automatic  X-Ray  Inspection  System) 
computer  program  is  to  develop  a  system  capable  of  automatically 
examining  film  radiographs  of  high  explosive  shells  and  making 
accept/reject  decisions  based  on  the  presence  or  absence  of  certain 
classes  of  defects  in  the  explosive  region  of  the  shell.  Among  the 
defect  classes  are  small  and  large  cavities,  cracks,  pipes,  annular 
rings,  foreign  inclusions,  regions  of  high  porosity,  and  base  sepa¬ 
ration.  The  defect  indications  have  low  contrast  against  a  high 
contrast  background,  and  some  of  them  have  dimensions  comparable  to 
the  grain  size  of  the  film. 

Techniques  to  identify  and  measure  these  defects  have  been 
developed  and  demonstrated  on  radiographs  of  105-mm  Ml  artillery 
shells  using  a  general  purpose  digital  image  processing  system  at 
the  Lockheed  Palo  Alto  Research  Laboratory.  More  recently,  a 
speedup  in  running  time  by  some  350  times  has  been  achieved  through 
the  use  of  an  array  processor,  so  the  design  goal  of  10  seconds  per 
shell  can  now  be  approached.  A  proposed  configuration  for  a  proto¬ 
type  system  has  been  established,  and  work  is  progressing  on  ex 
tending  the  techniques  to  include  the  M456  antitank  rounds  which 
have  a  more  complicated  internal  structure  than  the  Ml  shells. 

The  equipment  configuration  proposed  for  implementing  the 
techniques  at  the  required  speeds  is  shown  in  figure  1.  The  limit¬ 
ing  blocks  in  the  diagram  are  the  scanner-integrator  for  image 
quality  and  the  array  processor  for  computational  speed.  Experi¬ 
ments  indicate  that  the  use  of  a  high  resolution  1.5-inch  vidicon 
camera,  followed  by  logarithmic  digitization  and  nine  frames  of 
digital  integration,  can  reduce  the  entire  TV  contribution  to  less 
than  0.0060.  Thus,  the  system  can  provide  sufficient  image  quality 
for  successful  operation  of  the  detection  algorithms. 

The  five  main  categories  of  processing  algorithms  are: 

1.  Field  flattening  to  remove  the  intensity  trend  using  poly¬ 
nomial  fitting. 

2.  High  and  low  pass  filtering  for  noise  removal  and  for 
enhancement  of  certain  defects. 

3.  Variable  threshold  setting  based  on  histogram  analysis 
used  to  separate  flaws  from  noise. 

4.  Measurement  of  the  maximum  width,  maximum  length,  and 
orientation  of  defects. 
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5.  Detection  of  base  separation. 

This  system  has  been  designed  to  replace  the  skilled  human  inspec¬ 
tor.  When  implemented,  it  will  detect  and  measure  defects  automat¬ 
ically  and  quicker  than  can  be  done  by  the  inspector. 


FIELD  FLATTENING 


The  image  density  is  sampled  at  500-pm  intervals  and  digitized 
to  512  levels  to  form  a  200-  by  300-picture  element  (pixel)  array. 
The  result  for  a  typical  radiograph  is  shown  in  figure  2.  Large 
density  variations  occur  within  the  charge  region  due  to  shell 
geometry  (e.g.,  casing  diameter  and  thickness).  Figure  3  shows  the 
intensity  variation  along  the  row  designated  by  the  horizontal 
cursor  in  figure  2.  These  systematic  intensity  variations  are 

large  compared  with  intensity  changes  caused  by  flaws  and,  there¬ 
fore,  must  be  removed  before  the  flaws  can  be  detected.  The  inten¬ 
sity  variation  with  horizontal  distance  is  much  better  behaved  (in 
the  sense  of  being  approximated  by  a  low— order  polynomial)  than  in 
the  vertical  direction.  For  this  reason,  the  field  flattening 
algorithm  takes  its  input  one  horizontal  row  at  a  time,  fits  the 
intensity  variation  in  the  charge  region  with  a  polynomial,  sub¬ 
tracts  the  estimated  intensity  from  the  actual  intensity,  and  dis¬ 
plays  the  difference  (i.e.,  the  field  flattened  image). 

Much  effort  has  been  devoted  to  improving  field  flattening 
techniques  because  residual  trends,  which  remain  after  field  flat¬ 
tening,  determine  the  smallest  flaws  which  can  be  detected.  The 

problem  is  to  find  a  method  which  fits  the  systematic  variation 
(which  is  particularly  difficult  due  to  steep  slope  near  the  shell 
casing)  without  following,  and  thereby  subtracting  ,  the  variation 
caused  by  the  flaws.  The  technique  which  gives  the  best  result  is 
a  fourth-order  polynomial  operating  separately  on  strips  from  the 

first  25%,  middle  50%,  and  last  25%  of  the  pixels  within  a  single 

line. 


The  result  of  the  field  flattening  operation  is  shown  in  fig¬ 
ures  4  and  5.  In  these  figures  the  estimated  systematic  trend  has 
been  subtracted  and  the  difference  multiplied  by  a  factor  of  8. 
The  flaws,  which  are  apparent  in  these  figures,  could  not  be  ob¬ 
served  in  the  input  images. 
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FILTERING 


The  noise  caused  by  film  granularity  and  television  electron¬ 
ics  is  large  compared  with  field  flattening  residuals •  This  noise 
is  characterized  by  high  spatial  frequency  (i.e.,  only  a  small 
amount  of  correlation  between  adjacent  pixels)  and,  therefore,  can 
be  reduced  by  spatial  low-pass  filtering.  However,  filter  param¬ 
eters  must  be  chosen  which  reduce  the  noise  as  much  as  possible 
without  significantly  reducing  the  amplitude  of  variations  caused 
by  flaws.  The  filter  chosen  is  a  3-  by  3-pixel  moving  window  aver¬ 
age.  The  result  of  low-pass  filtering  is  given  in  figures  6  and  7, 
which  show  that  the  flaws  are  still  clearly  visible  and  the  noise 
is  markedly  reduced. 


THRESHOLDING  OPERATION 


Pixels  within  cracks,  cavities,  and  porosities  have  intensity 
values  which  are  lower  than  "normal"  and  pixels  within  foreign 
inclusions  have  intensity  values  which  are  higher  than  "normal" 
(figs.  6  and  7).  However,  the  problem  is  complicated  by  the  fact 
that  these  "normal"  values,  i.e.,  threshold  values  (outside  of 
which  a  pixel  is  potentially  a  defect)  vary  throughout  the  charge 
region.  The  principal  causes  of  these  threshold  variations  are  the 
spatial  variation  of  the  noise  and  residual  trends  left  after  field 
flattening. 

To  compute  these  spatially  dependent  thresholds,  the  charge 
region  is  divided  into  25-  by  25-pixel  areas  as  shown  by  the  grid 
in  figure  6.  The  window  chosen  was  large  enough  so  that  the  sta¬ 
tistics  would  not  be  unduly  influenced  by  flaws,  but  small  enough 
that  the  flaws  would  not  vary  too  much  within  the  window.  Within 
each  window  of  the  field-flattened  image,  the  histogram  of  the  625 
intensity  values  is  computed  and  used  to  determine  that  intensity 
value  which  is  greater  than  the  intensity  of  10%  of  the  pixels  in 
the  window. 

The  thresholding  operation  takes  as  its  inputs  the  filtered, 
field-flattened  image  and  the  position-dependent  threshold  values 
and  produces,  as  output,  an  image  in  which  all  pixels  having  inten¬ 
sity  less  than  the  lower  threshold  are  marked  with  the  value  501, 
and  those  above  the  upper  threshold  are  given  the  values  502.  The 
Defect  Processing  System  uses  these  marks  to  distinguish  between 
foreign  inclusions  and  cavities,  etc.  Pixels  having  values  between 
these  two  thresholds  (i.e.,  in  the  "normal"  range)  are  given  the 
value  zero. 
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A  typical  histogram  and  cumulative  histogram  of  intensities  in 
a  25-  by  25-pixel  window  are  shown  in  figure  8*  The  threshold  was 
set  at  that  intensity  value  where  the  cumulative  histogram  reaches 
10%  of  the  pixels  in  the  window  ( 10%  of  the  pixels  are  considered 
candidate  defect  pixels). 

The  region  exterior  to  the  boundary  was  set  at  a  value  of  511 
to  handle  the  case  where  the  boundary  cuts  through  portions  of  the 
window.  This  results  in  a  spike  in  the  histogram  at  511  (fig*  8). 
In  the  threshold  computation,  consideration  is  given  to  the  number 
of  511  marked  pixels  in  the  window  by  setting  the  cumulative  number 
of  pixel  thresholds  to  0.1  [625  -  N(511)]. 

DEFECT  MEASUREMENT 


Defect  pixels  are  grouped  together  based  on  a  line  adjacency 
criterion  in  which  contiguous  defect  pixels  which  overlap  from  row 
to  row  are  considered  to  belong  to  the  same  group.  The  perimeter 
pixels  of  connected  groups  are  obtained  in  the  host  computer  start¬ 
ing  with  the  binary  representation  (fig.  9).  Each  group  is  then 
analyzed  for  maximum  width,  maximum  length,  and  orientation  using 
the  array  processor  by  means  of  the  dot  product  approach. 

The  approach  is  based  on  the  observation  that  if  we  project  a 
line  connecting  two  boundary  pixels  onto  a  ray  of  unit  vectors 
radiating  from  the  origin,  the  largest  projection  of  the  line  is 
obtained  for  the  unit  vector  most  parallel  to  the  line.  Thus,  we 
use  a  set  of  unit  vectors  10  degrees  apart  radiating  from  an  ori¬ 
gin,  and  take  the  dot  product  of  every  boundary  pixel  of  a  defect 
group  and  each  unit  vector.  We  then  find  the  maximum  absolute 
difference  (MAD)  between  the  smallest  and  the  largest  dot  product 
for  each  unit  vector.  The  largest  MAD  gives  the  flaw  orientation. 
The  MAD  on  the  unit  vector  normal  to  the  orientation  gives  the 
maximum  width.  A  report  is  printed  out  on  defects  with  measure¬ 
ments  exceeding  specifications. 


DETECTION  OF  BASE  SEPARATION 


Base  separation  is  a  defect  which  occurs  when  the  explosive 
separates  from  the  metal  casing  in  the  base  region.  This  subtle 
flaw  must  be  detected  in  the  presence  of  a  dominant  intensity  trend 
caused  by  the  explosive-metal  transition  and  random  noise  caused  by 
film  granularity  and  television  electronics.  The  detection  is 
complicated  by  the  fact  that  the  flaw  is  quite  narrow,  on  the  order 
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of  0.01  inch  wide.  For  this  reason,  a  magnified  television  image 
is  used  in  which  the  pixel  spacing  is  125  ttn  (i.e.,  200  pixels  per 
inch) . 


The  first  step  is  to  determine  the  precise  location  of  the 
metal  case  in  the  base  region.  This  is  accomplished  by  examining 
the  intensity  values  within  each  separate  column  and  taking  as  the 
boundary  estimate  that  pixel  having  the  largest  derivative.  These 
boundary  estimates  are  refined  by  the  use  of  a  least  square,  sec¬ 
ond-order  polynomial • 

To  reduce  the  film  and  television  system  noise,  it  is  neces¬ 
sary  to  filter  the  data  by  an  averaging  operation.  To  enhance  the 
signal  caused  by  the  flaw,  this  averaging  should  be  carried  out 
along  the  flaw.  In  the  case  of  base  separation,  this  direction 
along  the  flaw  is  known  because  it  follows  the  base  boundary; 
therefore,  the  intensity  is  averaged  within  "layers"  parallel  to 
the  boundary  determined  from  the  second -degree  polynomial.  This 
averaging  is  carried  out  over  a  "sector"  having  a  width  comparable 
to  the  length  of  typical  base  separation  flaws.  This  process  is 
conceptually  similar  to  a  curved  moving-window  average  one  pixel 
high  and  one  sector  wide.  In  this  sense  the  operation  is  analogous 
to  the  low-pass  filtering  operations  used  in  the  main  portion  of 
the  shell. 

The  measured  average  intensities  are  fitted  with  a  least 
square,  second-degree  polynomial.  Points  in  the  region  where  base 
separation  can  occur  are  not  used  in  deriving  the  polynomial  ap¬ 
proximation;  this  prevents  flaws  from  influencing  the  fit.  A  sig¬ 
nificant  deviation  between  the  actual  and  the  fitted  data  signals 
the  presence  of  a  base  separation. 

The  threshold  value  (beyond  which  the  shell  is  rejected  as 
having  a  base  separation)  varies  from  shell  to  shell  because  of 
changing  film  response.  These  sensitivity  variations  are  accommo¬ 
dated  by  computing  the  threshold  for  each  image  based  on  differ¬ 
ences  between  intensity  values  at  certain  prescribed  points  on  the 
intensity  profile.  Once  the  threshold  is  computed,  it  is  a  simple 
matter  to  determine  whether  the  deviation  is  too  large  and  to  print 
out  this  result  on  the  computer-generated  report. 


SPEEDUP  USING  THE  ARRAY  PROCESSOR 


The  dramatic  speedup  achieved  through  the  use  of  an  array 
processor  is  indicated  in  table  1  where  the  current  times  for  each 
process  are  compared  with  those  required  when  the  algorithms  were 
programmed  in  Fortran  on  a  relatively  slow  minicomputer. 
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Table  1.  Timing  for  major  processing  steps 
(200-  by  300-pixel  image) 


Processing  step 


Minicomputer  Array  processor 

time  (min)  time  (sec; 


Field  flattening  44 
Filtering  2 
Thresholding  9 
Defect  measurement  3 


3  to  6 
1 
1 
4 


Base  separation 


1 
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The  array  processor  (in  this  case,  a  Floating  Point  System 
AP120B)  achieves  its  speed  in  four  principal  ways,  through  the  use 
of  : 

1*  extremely  fast  hardware  floating  point  arithmetic  opera¬ 
tions 

2*  "pipelining"  or  parallel  operations  on  serial  data 

3.  systematic  data  arrangement  which  eliminates  the  need  for 
software  indexing  operations 

The  AP120B  offers  an  extensive  library  of  Fortran-callable 
mathematical  subroutines  which  carry  out  the  same  operation  on  all 
the  elements  of  one  or  more  arrays  incrementing  index  pointers 
approximately  and  automatically.  Moreover,  the  subroutines  can  be 
"chained"  or  combined  to  eliminate  the  overhead  required  to  call 
each  one  separately  from  the  host  computer.  A  certain  ability  for 
thinking  of  problems  in  array  or  "vector"  terms  develops  with  a 
little  experience,  to  the  point  where  a  surprising  number  of  oper¬ 
ations  can  be  implemented  efficiently  in  this  way.  Even  more 
speedup  can  be  achieved,  should  it  be  required,  by  increasing  the 
size  of  the  array  processor's  program  memory,  using  a  higher  speed 
data  memory,  or  programming  key  steps  in  machine  language. 
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IMPLEMENTATION 


Once  the  techniques  described  herein  have  been  successfully 
extended  to  the  M456  antitank  shell  with  its  internal  conical 
structure,  prototype  implementation  can  begin.  In  addition  to  the 
software  processing  steps  described,  hardware  and  software  for  such 
operations  as  film  positioning  and  movement,  report  generation,  and 
overall  sequency  and  control  must  be  designed  for  full  implementa¬ 
tion.  It  is  anticipated  that  the  resulting  system  will  not  only 
perform  the  work  as  well  as  the  skilled  human  inspector,  but  will 
do  so  automatically  and  in  a  shorter  time. 
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Figure  1.  Block  diagram  of  proposed  system  for  real-time  automated  x-ray  film  reader 


Figure  2.  Digitized  version  of  a  radiograph  of  the  aft 
section  of  artillery  shell 
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Figure  3.  Intensity  values  along  horizontal  cursor  in  figure  1 
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Figure  4. 


Result  of  field  flattening  with  a  three-strip, 
fourth-order  polynomial 
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Figure  5.  Intensity  values  (along  horizontal  cursor  in  fig*  1) 
after  field  flattening 
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Figure  6.  Result  of  low-pass  filtering  using  a  3-  by  3-pixel 
moving-window  average 
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Figure  7.  Intensity  values  after  low-pass  filtering 


N(511 ) 


Threshold  Used 


b.  CUMULATIVE  HISTOGRAM  OF  WINDOW  PIXELS 


Figure  8.  Histogram  and  cumulative  histogram  used  to 
obtain  threshold  setting 
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Figure  9.  Binary  image  showing  pixel's  exceeding  local  thresholds 
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